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Abstract - Understanding the mutual interdependence between the behavior of dynamical pro- 
cesses on networks and the underlying topologies promises new insight for a large class of empirical 
networks. We present a generic approach to investigate this relationship which is applicable to 
a wide class of dynamics, namely to evolve networks using a performance measure based on the 
whole spectrum of the dynamics' time evolution operator. As an example, we consider the graph 
Laplacian describing diffusion processes, and we evolve the network structure such that a given 
sub-diffusive behavior emerges. 



Introduction. — The importance of networks as a 
fruitful modeling approach to very diverse scientific areas 
is nowadays well established. While initially the network 
topologies were in the focus of investigation, presently the 
main interest lies in dynamics taking place on networks — 
in the sense that the network defines the interaction pat- 
tern between the individual elements of the dynamical pro- 
cess [THS]. Additionally, networks are commonly evolving 
over time and alter their structure due to random muta- 
tions or directed changes, growth, or shrinkage, modifying 
the dynamical behavior. Since in most cases the function- 
ality of a network is provided by the dynamics, evolution 
favors structures with a better dynamical performance and 
eventually adapts towards an optimal topology. A deeper 
understanding of this mutual relation between structure 
and dynamics can be achieved either by studying empirical 
systems directly, in a biological context for instance phys- 
iological networks [7] , food webs [8] , or protein interaction 
networks [9j , or by modeling of network evolution towards 
a desired dynamical performance and in this way gain 
new insight into many empirical networks. Concerning 
the latter, the evolution of dynamical networks was pre- 
viously applied in the contexts of modularity in changing 
environments [10], Boolean (threshold) dynamics pTtflB] . 
and synchronization of oscillatory systems [T7]-[2T]. It is 
known that the dynamical behavior is closely related to 
the network's spectral properties [22], which was exploited 
in studies in which the Laplacian eigenratio [23] was maxi- 
mized by network evolution [T7H2Q] . Other studies carried 
out the dynamics expHcitly [TIV[T5l [2T] , which can be com- 



putationally very costly. 

In this Letter, we present an alternative approach based 
on the whole eigenvalue spectrum of the time evolution 
operator Oa of linear dynamics. Specifically, we consider 
dynamics on a network with vertices described by a 
linear equation. 
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where p(t) = . . . ,pAr(^))^ represents the dynam- 

ical state at time t. Depending on the problem under 
consideration, p(t) can denote the activity of the individ- 
ual vertices, their phases, the distribution of a substance 
flowing across the network, the probability distribution of 
some event to occur, etc. The operator Oa depends on 
the network topology described by the N x N adjacency 
matrix A of the network (with elements Aij = 1 if vertex 
i is linked to vertex j and Aij = otherwise). In contrast 
to studies on coevolutionary networks [24 , we regard the 
time scales of the dynamics on the network and of the 
structure modifications as being well separated, which is 
the case in many empirical networks (consider for exam- 
ple cellular processes such as protein-protein interaction 
or gene regulation compared to biological evolution). 

Model. — The eigenvalues of Oa, Aj^, can be repre- 
sented in a functional form by the integrated density of 
states (DOS), 
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where B denotes the Heaviside step function, Q{x) = 1 for 
X > and B(x) = for x < 0. Our approach to quantify 
the dynamical performance via the eigenvalue spectrum 
is to establish a distance metric A(/, 7*^^^®*) between any 
/ and a predefined (but not necessarily realizable) J^^^^et 
yielding the desired dynamical behavior. The evolution of 
a network structure consists of two parts, carried out in 
each evolution step n. First, a candidate network is con- 
structed from the present one by a random modification 
in the topology (mutation). Secondly, the candidate is ac- 
cepted or rejected for the next step by a criterion based 
on the values of A(/, 7*^^^®*) before and after the muta- 
tion (selection). If the distance metric and the criteria 
for mutation and selection are chosen appropriately, the 
evolution will eventually converge to an optimal network 
structure for a given Oa and desired dynamical behavior. 

In the following discussion, we exemplify our approach 
by considering simple graphs and the graph Laplacian L, 
given by 



h if ^ = j , 



(3) 



with 6ij being Kronecker's delta and ki 



X] . Aij the de- 



gree of vertex z, as dynamical operator, i.e., Oa = —CL 
with C > being a (diffusion) constant. The graph Lapla- 
cian L is of importance in many physical situations |25!, 
such as electrical or other flow networks ^26^, Gaussian 
spring networks as polymer models [27] , random walks [28] 
as the space discrete equivalent of diffusion, and synchro- 
nization [29]. In the context of diffusion, p{t) denotes the 
probability to find the random walker at a given vertex 
at time t and eq. ([1]) is the master equation describing 
its time evolution. Many properties of the random walk, 
such as the average probability of returning to the origin 
at time Po(^) = YliLi^^Pi~'^i^'^)^ determined 
by the spectral dimension defined via the scaling of the 
integrated DOS [30], 



/(A) oc X^^^^ . 



It is known that Po(^) decays for t ^ oo as a power- 
law, Po(^) cx t~^^^'^ [H]. For ah uniform Euclidean sys- 
tems without broad waiting time distributions, the mean- 
square displacement of the random walk scales linear with 
t and Po(^) decays as where d is the spatial dimen- 

sion. This behavior is called normal diffusion and the cor- 



responding spectral dimension is 



(n) _ 



d, whereas non- 



linear scaling is referred to as anomalous diffusion [30] . An 
interesting and challenging goal is to optimize a network 
structure for a given fixed 1 < < 2, such that Po(^) 
decays slower than in the regular two-dimensional (2d) 
case (sub-diffusion), which will be the desired dynamical 
behavior in the following. 

In the present case of the graph Laplacian, there are two 
issues to be addressed. First, the scale of the Laplacian 
eigenvalues is to first order given by the degrees {ki} as 



largest elements of L, located along the diagonal, whereas 
all non-zero off-diagonal elements are —1. Hence, we con- 
sider the rescaled eigenvalues Aj, = A^^/ max^^/jAj,/}, which 
reduces the dependence of the eigenvalue spectrum on the 
degrees and does not change the scaling of /(A). Second, 
since the spectral dimension ds appears in the exponent of 
eq. dl]), we introduce the logarithmically integrated DOS, 



/(In A) = In 
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The measure of dynamical performance can then be de- 
fined by the metric 

A(/,/*^^set) _ / ^ I{\nX)-l'^'^^\\nX) din A 

(6) 

where / is the present and is the target logarith- 

mically integrated DOS. The lower integration boundary 
InAmin is chosen such that /*^''s®*(ln A) < ln(7V"^) for 
InA < InAmin and /*^^g^*(lnA) > \n{N-^) for InA > 
InAmin- (Note that /*^^s®*(lnA) is a monotonic, but not 
necessarily continuous function; if /^^^^^^(InA) is continu- 
ous, then /*^^g^*(ln Amin) = ln{N-^).) 

Concerning the basic evolution step, we have chosen 
the mutation such that a minimal change in the eigen- 
value spectrum is ensured. A randomly chosen edge is 
removed from the network and a new edge between two 
previously unconnected vertices is introduced. The selec- 
tion consist of two parts. If the modification separates 
the network into two disconnected components then it is 
rejected directly. Otherwise, the mutation is accepted if 
it decreases the value of the metric A(/, 7*^^^®*). In this 
way, the evolving network performs an adaptive walk in 
the space of connected simple graphs with both numbers 
of vertices N and edges M fixed. 

Results. — As a first test of our evolution- 
ary algorithm, we specify the target integrated DOS 
as /t^rget(^) ^ ^d./2 yielding /*^^g^*(lnA) = 4/2 InA, 



(^4j with two exemplary values dg^^ = 1.4 and ds^^ =1.1 both 
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in the sub-diffusive regime well below di^"^ = 2 for a two- 
dimensional system. In order to verify to which extent 
the outcome of the evolution depends on the initial condi- 
tions, i.e., how much of the evolutionary history remains 
imprinted in the networks, we start the evolution from 
two classes of initial networks, (i) 2d square lattices with 
periodic boundary conditions; and (ii) connected random 
graphs G{N^ M) (simple graphs with vertices and M 
randomly chosen edges, restricted to form a single con- 
nected component). While in 2d square lattices all vertices 
have the same degree = 4, random graphs G(A^, M), 
just as the famous Erdos-Renyi networks, obey a Poisson 
degree distribution, P{k) = r]^e~^ /kl^ with mean degree 
(/c) = ?7 = 4 here. All inital networks are chosen to have 
A" = 361 vertices. Each evolution is driven for 10^ steps 
and repeated with different random seeds for 100 realiza- 
tions. 
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Fig. 1: (Color online) Distribution of the distance mea- 
sures A(/, p^^set^^ ^ function of the step number n evolving 
with a power-law DOS /'"^^"'(InA) = d,/2 In A with di^^ = 1.4 
(main plot) and d!^^ = 1.1 (inset) as target. The lines display 
the mean distance measure of 100 realizations of the evolu- 
tion starting from 2d square lattices (green dashed lines) and 
random graphs (red solid lines), and the error bars mark one 
standard deviation of the respective distributions. 

In fig. [TJ the distributions of the distance mea- 
sure A(/, /target j showu as a function of the step num- 
ber n for the evolution starting with networks from the two 
classes of initial networks and evolving towards d^^ =1.4 
(main plot) and = 1.1 (inset). In all cases, the dis- 
tance measure A(/, 7*^^^®*) decreases slowly for about 10^ 
steps, then drops quickly by an order of magnitude within 
the following decade, and afterwards continues to decrease 
only marginally. The distributions of the distance mea- 
sure A(/,/*^^s®*) for the two choices of initial conditions 
become indistinguishable after around 10^ evolution steps. 

Typical realizations of the logarithmically integrated 
DOS, as occurring during the evolution process shown in 
fig. [U are depicted in fig. O We display four examples, 
two initial networks and two networks at step n = 10^, 
having been evolved with target d^^ = 1.4 from an ini- 
tial 2d square lattice with periodic boundary conditions 
and ds = 1.1 from a connected random graph G{N^M). 
One notices that after 10^ steps, the logarithmically inte- 
grated DOS follows the respective target, P^^^^^{\i[iX) = 
ds/2 In A, very closely up to immanent discretization. 

The average probability Po{t) for a random walker to 
return to its origin at time t is obtained for the initial 
as well as for the evolved networks and is shown in fig. [3l 
For the evolved networks, Po{t) indeed follows a power-law 
Po{t) oc with di'^^ = 1.4 and dP = 1.1, respectively, 

as expected from the linear scaling of /(In A) in fig.[2j Note 
the rather small dynamical heterogeneity indicated by the 
error bars (displaying one standard deviation). 

Given the convergence of the dynamical performance, 
the question arises as to how similar the underlying net- 
works are topologically. In fig. IH the degree distribu- 
tions P(/c), being the probability that a randomly chosen 



Fig. 2: (Color online) Logarithmically integrated DOS /(In A) 
exemplified using individual realizations, two initial networks 
(light colors) and two networks after 10^ evolution steps with 
different 7*^^^^* (In A) (dark colors). Results are shown for evo- 
lutions with ds^'* = 1.4 starting from a 2d square lattice (green 
dashed lines) and = 1.1 starting from a random graph 
(red solid lines). The two target logarithmically integrated 
DOS /*^'s^*(lnA) = ds/2 In A are shown as references (black 
dotted lines) with annotated slopes. 
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Fig. 3: (Color online) Average probability Po{t) for a ran- 
dom walker to return to its origin at time t on the initial 
networks (light colors) and evolved networks after 10^ steps 
with power-law DOS 7^^'^''* (In A) = ds/2 In A as targets (dark 
colors) for evolutions with di^^ = 1.4 starting from 2d square 
lattices (green dashed lines) and dP'* = 1.1 starting from ran- 
dom graphs (red solid lines). The lines display the mean of 
100 realizations and the error bars mark one standard devi- 
ation of the distributions. The black dotted lines are guides 
to the eye and have slopes of —d^^^/2 = — 1, —d^^^/2 = —0.7, 
and —d^^/2 — —0.55, as annotated, indicating the expected 
scaling behavior. 

vertex has degree /c, of the two initial and the correspond- 
ing evolved networks are shown. Despite the dissimilari- 
ties in the degree distributions of the two classes of initial 
networks (Poisson vs. delta distribution), the degree dis- 
tributions of the evolved networks are quite alike on the 
level of averages. Nevertheless, there is significant varia- 
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Fig. 4: (Color online)Degree distributions P(k) of — from left to 
right — the two initial and the corresponding evolved networks 
after 10^ evolution steps, i.e., 2d square lattices (1st bar, light 
green), random graphs with mean {k) = 4 (2nd bar, light red), 
and the resulting networks after evolution towards a power-law 
DOS /'"'S"'(ln A) = ds/2 In A with di'^^ = 1.4 as target (3rd bar, 
dark green, and 4th bar, dark red). The histogram bars display 
the mean of 100 networks, and the error bars mark one stan- 
dard deviation. The insets display the distribution of Newman 
coefficients r and clustering coefficients c as a function of the 
step number n for evolutions starting from 2d square lattices 
(green dashed lines) and random graphs (red solid lines). The 
lines display the averages over 100 networks, and the error bars 
mark one standard deviation of the distributions. 



tion from network to network as can be seen, for example, 
by the large standard deviation for /c = 5 indicated by 
the error bars. While very few vertices with the average 
degree k = 4 are present, the fraction of vertices with 
higher {k = 6) and lower {k = 1,2) degrees increases in 
the course of the evolution suggesting that the networks 
become more heterogeneous. 

To gain further insight into the resulting network 
topologies, we display in the insets of fig. |4] the average 
degree assortativity or Newman coefficient r and the av- 
erage clustering coefficient c as function of the evolution 
step number n. The Newman coefficient r [32] is the 
Pearson correlation coefficient of degrees of two vertices 
connected by an edge and hence measures the amount of 
degree-degree correlation (degree assortativity) in a net- 
work. A network without degree-degree correlations has 
r = 0. In our example, the networks become assort a- 
tive in the course of the evolution (r > 0), meaning that 
connections preferentially exist between vertices of similar 
degree, another indicator for heterogeneity in the network 
structure. The clustering coefficient c, defined as the den- 
sity of triangles [33], measures the transitivity of a net- 
work, i.e., the tendency that the neighbors of a given ver- 
tex are connected to one another. For a connected graph 
with fixed numbers of vertices and edges, an increasing 
clustering coefficient c indicates, again, a trend towards 
more heterogeneous structures. We observe that although 
the network evolution converged in less than 10^ evolution 



steps with respect to the dynamical behavior and the New- 
man coefficient, the clustering coefficient is still increasing 
and broadly distributed. As the changes in the differ- 
ent observables do not coincide with the changes in the 
dynamical behavior, we conclude that even with a given 
eigenvalue spectrum there is some structural freedom left 
for variation in 3-point properties such as transitivity and, 
despite the dynamical behavior being essentially identical 
after 10^ evolution steps, the underlying network topolo- 
gies can still be rather diverse. We do not observe any 
systematic differences between networks evolved from reg- 
ular lattices or random graphs suggesting that already this 
simplest version of our evolutionary algorithm suffices to 
explore the relevant region of the network configuration 
space in a reasonable number of evolution steps. 

Conclusion. — Most networks, in particular as oc- 
curring in biology, are not static entities but instead con- 
stantly evolve over time. Even though a given change usu- 
ally affects the network structure in the first place, its fate 
is decided by the resulting alteration of the dynamics on 
the network providing its functionality, so that evolution 
favors topologies with a better dynamical performance. 
We study the relationship between network structure and 
dynamics by means of network evolution using a perfor- 
mance measure based on the whole eigenvalue spectrum of 
the time evolution operator of linear dynamics. By this, 
we avoid the explicit calculation of the dynamical time 
evolution, which can be computationally very costly. To 
exempHfy our approach, we use the graph Laplacian de- 
scribing a diffusion process, and evolve networks such that 
a given sub-diffusive behavior emerges. Interestingly, the 
resulting networks show an overall trend towards hetero- 
geneous structures and, despite displaying essentially the 
same dynamical behavior, are structurally quite diverse. 
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